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Quasi-birth-and-death (QBD) processes with infinite “phase spaces” 
can exhibit unusual and interesting behavior. One of the simplest ex¬ 
amples of such a process is the two-node tandem Jackson network, 
with the “phase” giving the state of the first queue and the “level” 
giving the state of the second queue. 

In this paper, we undertake an extensive analysis of the properties 
of this QBD. In particular, we investigate the spectral properties of 
Neuts’s 7?-matrix and show that the decay rate of the stationary dis¬ 
tribution of the “level” process is not always equal to the convergence 
norm of R. In fact, we show that we can obtain any decay rate from 
a certain range by controlling only the transition structure at level 
zero, which is independent of R. 

We also consider the sequence of tandem queues that is con¬ 
structed by restricting the waiting room of the first queue to some 
finite capacity, and then allowing this capacity to increase to infinity. 

We show that the decay rates for the finite truncations converge to a 
value, which is not necessarily the decay rate in the infinite waiting 
room case. 

Finally, we show that the probability that the process hits level n 
before level 0 given that it starts in level 1 decays at a rate which is not 
necessarily the same as the decay rate for the stationary distribution. 

1. Introduction. A quasi-birth-and-death (QBD) process is a two-dimensio¬ 
nal continuous-time Markov chain for which the generator has a block- 
tridiagonal structure. The first component of the QBD process is called 
the level, the second component the phase. 
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A comprehensive discussion of the properties of QBD processes with 
finitely many possible values of the phase variable can be found in the 
monographs of Neuts [11] and Latouche and Ramaswami [7]. In particu¬ 
lar, it is known that the level process of a positive-recurrent QBD process 
with a finite phase space possesses a stationary distribution which decays 
geometrically as the level is increased. The decay parameter is equal to the 
spectral radius of Neuts’s i?-matrix, which is strictly less than 1. Similarly, 
the probability that a QBD process hits level n before level 0 given that it 
starts in level 1 is known to decay geometrically with the same parameter. 

For QBD processes with an infinite phase space the situation becomes 
more complicated. The R-matrix is now infinite-dimensional, and its spec¬ 
tral properties are not obvious. Also, the relationship between various decay 
parameters is different from the finite-dimensional case. A start in the study 
of such processes was made by Takahashi, Fujimoto and Makimoto [17]. 
They gave conditions under which the infinite-dimensional R is a-positive 
(see Section 2 for a definition). Under a further condition on the stationary 
distribution at level 0, they were then able to infer that the stationary dis¬ 
tribution decays at rate a. However, as we shall see in Section 4, there are 
many circumstances where the conditions of [17] are not satisfied. 

The purpose of this paper is to make a contribution to the study of the 
behavior of infinite-phase QBD processes by considering a special case which 
exhibits interesting behavior. This special case is a two-node tandem Jackson 
network, in which the number of customers in the first queue gives the phase 
variable and the number of customers in the second queue gives the level 
variable. This system was studied via simulation in [6], where the authors 
used some of the results of the current paper to calculate the relevant decay 
rates. It is also a special case of the system studied in [3]. 

We show that, when the first queue has an infinite waiting room, the 
decay rate of the stationary distribution of the “level” process (the state of 
the second queue) may not be equal to the convergence norm of R, which 
can be thought of as the analogue of the spectral radius in the infinite¬ 
dimensional case. In fact, we show that we can construct a range of decay 
rates for the stationary distribution of the second queue by controlling only 
the transition structure when the second queue is empty, that is, at level 0. 
Futhermore, the decay rate, as n —> oo, of the probability that the number 
of customers in the second queue hits n before 0 given that it starts at 1 
may not be the same as the decay rate of the stationary distribution. Such 
behavior does not occur in finite-phase QBD processes. 

We also consider the limiting behavior of the tandem queue when the 
waiting room of the first queue is finite, and increases to infinity. We show 
that the eigenvalues of the i?-matrix converge to a continuum, possibly with 
one additional isolated point—the latter being the case when the second 
buffer is the bottleneck. A consequence of this is that the decay rate in the 
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infinite waiting room case may not be the same as the limiting value of the 
decay rates in the finite waiting room case. 

The rest of the paper is organized as follows. In Section 2 we present 
some general results for QBD processes. We consider processes with both 
finite and infinite phase spaces. In Section 3 we formulate the two-node 
tandem Jackson network as a QBD process. In Sections 4 and 5, we discuss 
the decay rate of the stationary distribution when the capacity of the first 
queue is infinite and finite, respectively. These sections make heavy use of 
the properties of certain orthogonal polynomials. In Section 6, we show 
how we can obtain any decay rate for the stationary distribution of the 
second queue by controlling the transition structure when the second queue 
is empty. In Sections 7 and 8, we turn to the question of the decay rate of 
the probabilities that the process hits level n before level 0. Section 7 deals 
with general QBD processes; Section 8 deals with the specific case of the 
tandem Jackson network. 


2. QBD processes. A level-independent QBD process is a continuous¬ 
time Markov chain (17, i > 0) on the state space {0,1,...} x {0,..., m}, 
whose generator Q has a block tridiagonal representation 


( 1 ) 


fQi 

Qo 



\ 

Q2 

Qi 

Qo 




Q2 

Qi 

Qo 




Q2 

Qi Qo 


V 




■■■) 


Here, the matrices Qo,Qi,Q 2 and Qi are (m -|- 1) x (m -|- 1) matrices. The 
parameter m may be finite or infinite. The random variable 1} is called the 
level of the process at time t and the random variable Jt is called the phase 
of the process at time t. 

To avoid complications, we assume that the following condition is satis¬ 
fied. A discrete-time version of this condition appeared in [9]. 


Condition 2.1. The continuous-time Markov chain on the set Z x 
(0,..., m}, with generator 


( 2 ) 




Q2 Qi Qo 
Q2 Qi Qo 


is irreducible. 


V 
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There are a number of consequences of Condition 2.1, which we shall use 
later. This condition is satisfied in the QBD process model for the tandem 
queue which is presented in Section 3. 

We set the stage by mentioning some well-known results, at the same time 
fixing some notation. By Theorem 3.2 of [13], the limiting probabilities Tikj '■= 
limt^ooP(Y '4 = k,Jt= j) exist. Let us define the vectors tt^ = • • •, T^km), 

for /c = 0,1,..., and tt = (tto, tti, ...). Then 

(3) 'Kk = TTQR^, A:>0, 

where R is the minimal nonnegative solution to the equation 

(4) Qq + RQi + R^Q2 = ^. 

The matrix R has a probabilistic interpretation. Let /r* be the mean sojourn 
time in state (/c,i), for A: > 1. Then R{i,j) is /r* times the total expected 
time spent in state {k + l,j) before first return to level k, starting from 
state {k,i). 

Before turning to the relation between the matrix R and the decay rates 
of interest, we discuss the issue of ergodicity, both for m < oo and m = oo, 
noting a small inaccuracy in the literature regarding the latter case. 

Theorem 2.2. The QBD process is ergodic, that is, tt is positive and 
has components which sum to unity, if and only if there exists a probability 
measure yo such that 

( 5 ) yo(Qi +-RQ2) = 0 
and 

(6) yov < 00 , 
where u = {I + R + Rf + ■ ■ ■)!. In this case 

(7) tto = yo/yoi^- 

The matrix Qi + RQ 2 in ( 5 ) is the generator of the process of iYt,Jt) 
filtered so that it is observed only when it is in level 0. Thus, the condition 
that there exists a probability measure satisfying ( 5 ) states that the filtered 
process at level 0 must be ergodic. 

In [13], condition (6) is replaced by the elementwise condition 

(8) ly < 00 . 

For the case m < 00 , both conditions are equivalent. However, when m = 00 , 
the latter condition is not sufficient, since it does not guarantee that ttq is 
nonzero; we may have ygiz = 00 even when v is finite. 
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Specializing to the case m < oo, inequality (6) is satisfied if and only if 

(9) sp{R) < 1, 

with sp(i?) denoting the spectral radius of R. 

If m is finite and there exists a vector x with xl = 1 such that 

(10) x((5o + Qi + Q 2 ) = 0 

and 

(11) x(5ol<x(32l, 

then the QBD is positive recurrent; see [11] or [10]. Under the additional 
assumption that Qi = Qi + Q 2 , this was proved for the infinite case by 
Tweedie [18]. Equation (11) can be interpreted as requiring that “the average 
drift of the level process is negative.” 

We now turn to the decay rate of the stationary distribution, assuming 
that the QBD process is ergodic. This decay rate is sometimes also referred 
to as the caudal characteristic. We start with a known result for the case 
m < 00 , stating that the geometric decay rate is given by the spectral radius 
of R. In [7], page 205, it was shown that 

lim = K, 

K^oo (sp(i?)^) 

where k is a constant. In other words, the marginal stationary probability 
that the QBD is in level K decays geometrically with rate sp(i?). 

Turning to the case m = oo the situation becomes more complicated, and 
we come to the core of one of the problems that are dealt with in this 
paper. We are looking for an “infinite-dimensional” analogue of the limiting 
result (12), and in particular for the role of the spectral radius of R in it. 
Clearly, R is now a square matrix of size 00 . 

There are at least two candidates to consider for this analogue. One ap¬ 
proach would be to consider i? to be a linear operator from the Banach 
space to itself. We could then hope that the decay rate we are looking 
for is given by the spectral radius of this operator, if it exists. We shall 
take a different approach, and use the infinite-dimensional analogue of the 
Perron-Frobenius eigenvalue of R. This is the convergence norm of R. 

Some relevant concepts about the Perron-Frobenius theory of nonnegative 
matrices are recalled below. For details we refer to [15, 16]. 

For a finite-dimensional, square, irreducible and nonnegative matrix A, 
there exists a strictly positive eigenvalue which is simple and is greater 
than or equal to the modulus of all the other eigenvalues. To this eigen¬ 
value corresponds a strictly positive eigenvector. The eigenvalue is called 
the Perron-Frobenius eigenvalue of A. 


( 12 ) 
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To a large extent, this result can be extended to infinite-dimensional ma¬ 
trices. Let ^ be a nonnegative, aperiodic and irreducible matrix. We would 
like to prove the existence of a strictly positive ^ and a strictly positive 
vector X such that 

(13) x^ = ^x. 

The power series 

OO 

k=0 

has a convergence radius a, 0 < a < oo, independent of i and j. This com¬ 
mon convergence radius is called the convergence parameter of the ma¬ 
trix A. When converges, the matrix is called a-transient. 

Otherwise it is called a-recurrent. An a-recurrent matrix A is a-null if 
limfc_>oo= 0 and a-positive otherwise. 

The quantity 1/a is called the convergence norm of A. It can be shown 
to satisfy 

(14) l/a= lim (A''(z,j))^/'' 

k^oo 

independently of i and j. This implies, in particular, that if the dimension 
of A is finite, then the convergence norm is exactly the Perron-Frobenius 
eigenvalue of A ([16], pages 200 and 201). 

For /3 > 0, a nonnegative vector x is called a -subinvariant measure of 
A if 

(15) /3xA<x 

and a nonnegative vector y is called a fi-subinvariant vector of A if 

(16) pAy < y. 

The measure x and vector y are called fi-invariant when equality holds in 
(15) and (16), respectively. 

The infinite-dimensional analogue of the Perron-Frobenius result is the 
following (see, e.g., [16], Theorems 6.2 and 6.3): 

No /3-subinvariant measure can exist for /3 > a. If A is a-recurrent, then 
there exists a strictly positive a-invariant measure. If A is a-transient, 
then there exists an a-subinvariant measure that is not invariant: there 
may or may not exist an a-invariant measure. By applying the above to 
the transpose of A, similar conclusions can be reached about a-invariant 
vectors. 
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It is a common misconception to believe that 1/a is the largest “eigen¬ 
value” of A. This is true in the finite-dimensional case, but not in the infinite¬ 
dimensional case. The result above states only that there cannot be any 
nonnegative x satisfying (13) with ^ < 1/a. In fact, in this paper we shall 
encounter examples of matrices A such that (13) is satished by a positive 
vector X for > 1/a. 

For infinite-dimensional matrices A it is useful to know when the conver¬ 
gence parameter a can be found as a limit of convergence parameters {a^^^} 
from a sequence of finite-dimensional matrices. For example, in The¬ 

orem 6.8 of [16], it is shown that the convergence parameters of the (n x n) 
northwest corner truncations of A converge to the convergence parameter 
of A. The following result will be of use to us in Sections 7 and 8. 

Lemma 2.3. Let be a sequence of nonnegative matrices that in¬ 

creases elementwise to an irreducible matrix A, as oo. Let denote 
the convergence parameter of A^^'i and let a be the convergence parameter 
of A. Then the sequence is decreasing with lim^^oca^^^ =a. 

Proof. By (14) and the fact that A^^\i,j) < we have 

Therefore the sequence {a^^^} is decreasing and its limit a(°°) must exist. 
Also, by (14) and the fact that A^^\i,j) < A{i,j) for all k, we have 

a<a(°°). 

Now let ... )^ be an a^^^-subinvariant vector of A^^\ with 

y^'^ = 1, and let y* = liminf^y^^^ elementwise. Then we know that 

Q,(fc)^Wy(fc) < yW. 

Taking liminffc^oo of both sides and using Fatou’s lemma, we have, for 
each i, 

OO 

(17) a(-)^A(z,j)y;<y/. 

Iterating this, we find that, for n >1, 

OO 

Since y\ = 1 and A is irreducible, this shows that y* < oo for all j and, 
by (17), that y* is an a(°°^-subinvariant vector of A. Since no /3-subinvariant 
vector can exist for (3 > a, we must have < a and thus = a. □ 
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Now let us turn back to the problem of determining the decay rate of f?”. 
From the definition, it follows that if convergent for all 

i and j, then the convergence norm of R must be less than or equal to 1. 
It is thus tempting to think that the decay rate of the stationary distri¬ 
bution must be given by the convergence norm. However, we have to be 
careful. As we noted above, it is a common misconception to believe that 
the convergence norm is the largest “eigenvalue.” 

Assume that w is a 2 :“^-invariant measure of R such that is fi¬ 

nite. Then z must be less than 1. To see this, note that the monotone conver¬ 
gence theorem implies that w converges elementwise to w ■ 

This means that converges elementwise to a finite vector, which 

can be the case only when z <1. This leads to the following result. 

Theorem 2.4. Consider an irreducible QBD process with a finite or 
infinite phase space. If there exists a nonnegative vector w G and a non¬ 
negative number z < 1 such that 

(18) w(Qi-L i?(52) = 0 
and 

(19) 'wR = zw, 

then the QBD is ergodic, and, for all fixed i = 0,1,..., 

( 20 ) 

for all K 

Theorem 2.4 shows that if ttq is a 2 ;“^-invariant measure of R for some z, 
then the stationary distribution of (Yt,Jt) has the level-phase independence 
property (see [8]) and decays at rate z. If ttq is a (finite) linear combination 
of more than one w (not necessarily nonnegative) that satisfies wR = fw 
for some then the stationary distribution does not have this property. The 
decay rate is then given by the value of in the linear combination for which 
1^1 is the largest. 

For the case m < oo, any ttq is a finite linear combination of eigenvec¬ 
tors of R. The left eigenvector of the eigenvalue sp{R) must always be in 
this linear combination. To see this, recall that ttq must be positive, and 
the Perron-Frobenius right-eigenvector v of ii must be nonnegative and 
nonzero, which implies that ttov > 0. Now write 

m 

TTq — ^ ) UjWj, 
i=l 


.K 


= Wi 
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where wi is the Perron-Frobenius eigenvector. Since, for i > 2, the Wj cor¬ 
respond to eigenvalues of R distinct from sp(i?), we know that WjV = 0 for 
these values of i. Therefore ttqv = aiwiv, which shows that ai ^ 0. This 
explains why the stationary distribution decays at rate sp{R) when m is 
finite. 

As a final topic in this section, we quote a result that helps us to determine 
2 :“^-invariant measures of R. In the general case m < oo it is easy to see 
from (4) that, if the row vector w and scalar z satisfy wR = zw, then 

(21) w(Qo T zQi + z‘^Q2) — 0 

whenever the change of order of summation involved in using the associative 
law of matrix multiplication is permitted. 

More important, under certain conditions the converse is true as well, 
again irrespective of whether m < oo or m = oo. This is shown in the next 
theorem, which is a statement of Theorem 5.4 of Ramaswami and Taylor [14] . 
See also [4] for a more detailed analysis for the case where m <oo. 

Theorem 2.5. Consider a continuous-time ergodic QBD process with 
generator of the form (1). Let = —Qi{k, k). If the complex variable z and 
the vector w = {wk} are such that \z\ < 1 and J2k\'’^k\Qk < oo, then (21) 
implies (19). 

Specializing to the finite case m < oo, we obtain the following corollary. 

Corollary 2.6. For an irreducible QBD process with a finite phase 
space, satisfying (11), the eigenvalues of R are all the zeros of the polynomial 

(22) det(Qo T ^Qi + z^Q2) 
that lie strictly within the unit circle. 

Proof. From the discussion above it follows that all eigenvalues of R 
lie within the unit circle. Each such eigenvalue z with corresponding left 
eigenvector w satisfies (21). Conversely, by Theorem 2.5, all solutions (^,w) 
to (21) with 2 : within the unit circle must be eigenvalue-left-eigenvector 
pairs of R, because the condition J2k < 00 is automatically satisfied. 

In particular, the eigenvalues of R are the zeros of (22) within the unit circle. 

□ 


3. The tandem Jackson network seen as a QBD process. We now turn 
to a specific class of QBD processes which may have infinitely many phases. 
It models a simple Jackson network consisting of two queues in tandem (see 
Figure 1). Customers arrive at the first queue according to a Poisson process 
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with rate A. The service time of customers at the first queue is exponentially 
distributed with parameter fii. On leaving the first queue, customers enter 
the second queue, where their service time has an exponential distribution 
with parameter ^ 2 - The capacity of the first queue is denoted by m, which 
may be finite or infinite. In the case when m is finite, customers that arrive 
to find the first queue full are rejected. For i = l,2 let 


A 



and let Jt and denote the number of customers in the first and second 
queue at time t, respectively. 

We shall examine the behavior of the two-dimensional Markov chain 
viewed as a QBD process in which represents the level and Jt 
represents the phase. The transition intensities of this QBD process are de¬ 
picted in Figure 2. When the capacity of the first queue is infinite, the phase 
space of this QBD process is inhnite and the boundary denoted by m in the 
figure is not present. 

For the case where m < oo, the (m -|- 1) x (m -|- l)-matrices Qo,Qi,Q 2 
and Qi in (1) are given by 


Queue 1 Queue 2 



Pig. 1. A tandem Jackson network. 


second 

buffer 



Pig. 2. The transition intensities for the tandem network. 
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Qo — 


(0 ... 

[XX 0 ... 

[lx 0 

V 0 / 

/-(A + // 2 ) A 


Q\ — 


( 


Q 2 — 


/^2 


J^2 


[i-2 ) 


— (A + //1 + // 2 ) A 


— (A + [ix+ [X 2 ) A 


-(w +J^2)/ 


and 


/-A A 

— (A + [lx) 


Qi — 


A 

— (A + /ii) A 


-Ail / 


Obviously, Condition 2.1 is satisfied in this case and the stability condi¬ 
tion (11) translates into 

1 - 

(23) P2 < — , Pi / 1) 

“ Pi 

(24) p2<l + —, Pi = l- 

m 

For the case where m = 00 , the tridiagonal blocks are given by the infinite¬ 
dimensional matrices 


Qo — 

/ 0 ... 

[XX 0 ... 

[Xx 0 

\ 

) Q 2 = 

( P2 

P2 

P2 

\ 





1 

/ 

Qi = 

/-{X + [X2) 

A 

— (A -|- Pi -l- P 2 ) A 

— (A -|- Pi -l- P 2 ) A 

\ 


V ••• •••/ 
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and 


Qi 


/-A A \ 

— (A + /ii) A 

— (A + /xi) A 

V •••/ 


In this case, the well-known condition under which both queues are stable 
is 


(25) 


A < min{/ii,//2}. 


For both finite and infinite m, we are interested in the decay rate of the 
stationary distribution of the tandem network as the number in the second 
queue becomes large and its relation to the spectral properties of the ma¬ 
trix R. It will be convenient to index this matrix with the size of the waiting 
room at the first queue. Thus we shall write Rm for the situation where the 
size of this waiting room is m and, in particular, R^o when the waiting room 
at the first queue is unlimited. 

For infinite m, under condition (25), it follows from the results of Burke [1] 
that the arrival process to the second queue is a Poisson process with param¬ 
eter A and so the second queue behaves like an M/M/1 queue with arrival 
rate A and service rate /i 2 - Thus the stationary distribution of the second 
queue is geometric with parameter p 2 and its decay rate is simply p 2 ■ How¬ 
ever, it is not at all clear how this decay rate corresponds to the spectral 
properties of the infinite-dimensional matrix R^o- 

To study the spectral properties of Roo we shall make use of Theorem 2.5. 
To facilitate our development, we introduce some notation. 

For each z with \z\ <1, z ^0, let Q{z) be the infinite-dimensional tridi¬ 
agonal matrix {Qq + zQi + z‘^Q 2 )lz, that is. 


(26) Q{z) 


/ -X- P 2 + IJ- 2 Z A 

Pl/z -X- Pi - P 2 + X 

V 


and let Q'^'^\z) denote the (n X n) northwest corner truncation of Q{z). 
For the finite case, define the (n x n)-matrix Q^^^z) as 

(27) 

/—X — P 2 + P 2 Z X \ 

Pl/z -X- Pi- P2+ P2Z X 

pi/z -P1-P2 + P2Z / 


V 
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The significance of these matrices follows from Theorem 2.5. The infinite¬ 
dimensional row vector w satisfies wi^oo = z'w for 2 7 ^ 0 with \z\ < 1 , if 
J2k\'^k\qk < 00 and w satisfies 

(28) 'wQ{z)=0. 

For the tandem queue, is constant for A: > 1 and so the condition that 
J2k\'^k\qk <00 is equivalent to requiring that w £ 

For the case m < 00 , the (m + 1)-dimensional row vector w is a left 
eigenvector of Rm corresponding to eigenvalue 2 : / 0 with \z\ < 1 , if and 
only if it satisfies 

(29) wQ(”^+^)(z) = 0. 


Remark 3.1. Readers may note that (28) and (29) are not exactly 
equivalent to (21). The latter follow from the former only if 2 ; 7 ^ 0. In fact, 
for the tandem network model, the vector ( 1 , 0 , 0 ,...) satisfies ( 21 ) with 
2 ; = 0 . 

By using the physical interpretation of Rm, we can see that the inter¬ 
esting 2 ;“^-invariant measures of Rm are the ones for which (28) and (29) 
are satisfied. For the tandem Jackson network, the expected time spent in 
any state at level k + 1 before the process returns to level k is nonzero if 
the process starts in a state {k,i) with i > 0. Thus we know immediately 
from its physical interpretation that Rm{i,j) is strictly positive for all i > 1 
and j > 0. On the other hand, it is impossible to visit level A: -|- 1 starting in 
state (A:,0) without visiting a state {k,i) with i > 1 first, and so Rm{0,j) = 0 
for all j. Thus Rm decomposes its indices into two communicating classes. 
Cl = {0} and C 2 = {1,2,... }. The eigenvector (1,0,0,...) of Rm with corre¬ 
sponding eigenvalue 0 has support on Ci. All other 2 ;“^-invariant measures 
of Rm have the form (t(;o,wi), where wi is a 2 ;“^-invariant measure of the 
positive submatrix Rm corresponding to C 2 . These are the w and 2 ; for which 
(28) and (29) are satisfied. 

4. The case where m is infinite. Before we start studying (28), we first 
give some preliminaries. In this and the following sections, we shall frequently 
use the function 


(30) r{z) = -X-fii-z) + 2 

It is easy to see that t(z) is convex on (0,1) with \\m.z^QT{z) = 00 , and 
t(1) = — (\/A — \/ar)^- Thus there is a unique value rj G (0,1) with T{ri) = 0, 
and, for 2 ; G (0,1), r ( 2)<0 if and only if z> rj. 
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We shall also frequently refer to the relationship between rj, pi and p 2 in 
the respective cases when pi < p 2 and pi > p 2 - These are summarized in 
the following lemma. 


Lemma 4.1. (a) When pi < p 2 , 0<r]<p2<pi<l- 

(b) When pi> P 2 , 0<pi<r]<p2<l- 

Proof. Observe that t{p 2 ) < 0, which immediately gives us that p 2 > p, 
and t{pi) = (1 — X/pi){pi — P 2 ), which gives us that pi>p when pi < p 2 
and Pi <p when pi> p 2 - Together with the fact that pi > p 2 if and only if 
hi ^ h 2 , this proves the lemma. □ 


Now consider the system of equations (28) where z is fixed such that 
z G (—1,1), z / 0. Writing out the system, we have 

(31) -{X +h 2 {^-z))zwo +hiwi=0, 

(32) Xzwk-i-{X +hi +^2(1-z))zwk +hiWk+i= 0 , k>l. 

After substituting Wk = u^ in (32), we derive the characteristic equation, 

(33) hiu^ — (A + /ii + h 2 {l — z))zu + Az = 0. 

Since the discriminant of (33) is positive if and only if z < 0 or r(z) < 0, 
the form of the solution now depends on the location of z relative to 0 
and p. We proceed by giving the solution for Wk in the cases — 1 < z < 0 and 
p < z <1. This is 

(34) Wk = ciui + C 2 U 2 , 


where 


(35) ni,2 = 


(A + + h 2 i^ - z))z ± a/(A + + ^ 2(1 - z)y^z'^ - AXpiz 

2pi 


The coefficients ci and C 2 can be derived from 


(36) ci + C2 = l, 

(37) ciui + C2U2 = —{X +h2ii - z))z, 

hi 

where the first equation is due to the (arbitrary) normalizing assumption 
that wo = l, and the second equation follows from boundary equation (31). 
Thus, we find 

^ _ 1 _ (A - +/i2(l - z))z _ 

2 2 a/(A + /ii + /i 2 (l - z))^z^ - AXhiz 
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When z = 7], the vector w is given by 
(38) Wk = u^{l + ck), 


with u = yJpiT] and c = 1 — \/r\j p\^ while for 0 < z < ry the real solution is 
given by 

(39) Wk = {cos{kcj)) + csm{k4>))\u\^, 

with |ri| = ^/piz, 


' = arctan 


/ ^AXpiz - (A + /ii + //2(1 - \ 

y {X + pi + ^ 2 ( 1 - z))z J 


and 


c = 


(A + yi 2 (l - z))^Jzl\px - cos{(j)) 


sm{4>) 

As we pointed out after equation (28), in order to use Theorem 2.5 to es¬ 
tablish whether w is indeed a -invariant measure of R, we need to verify 
whether w £ 

Lemma 4.2. The vector w is an element of if and only if 

Zi<Z< Pl/P2, 

where zi = (2A + pi+ P 2 - \/(2AT7T+"jr^j^"+4yI^)/( 2 /^ 2 ) < 0. 

Proof. First note that, for 0 < 2 : < ry, the form of (38) and (39) shows 
that it is certain that w £ Thus we need only consider the case when the 
roots ui and U 2 are real. This occurs when —l<z<0oicp<z<l. 

Unless z = 1 or z = p 2 both ci and C 2 are nonzero, so for w to be in it 
is necessary and sufficient that both ui and U 2 are in (—1,1). To study when 
this is the case, let f{u) be the left-hand side of (33). Then the statement 
that the roots ui and U 2 are in (— 1 , 1 ) is equivalent to saying that both 
/(-I) > 0 , /(I) > 0 , /'(-I) < 0 and /'(I) > 0 . 

When —1 < 2 < 0, /(I) is always positive and the condition that /(—I) 
is positive reduces to pi + (2A -|- yri -|- p 2 {^ — z))z > 0, which is the same 
as saying that zi < z. Furthermore, /'(I) is always positive and f'{—l) can 
be written as —/(I) — + Xz, which is negative if /(I) is positive. When 

ry < 2 ; < 1 , /(—I) is always positive and the condition that /(I) is positive 
is (1 — z){pi — ZP 2 ) > 0, which reduces to 2 ; < pi/p 2 - Furthermore f'{T) is 
always negative and f'{T) = /(I) — X + pi, which is positive when /(I) is 
positive by the stability condition (25). 

The observations that ry < pi/P 2 -, established by verifying that t(pi/P 2 ) < 
0 , and — 1 < 2:1 < 0 complete the proof. □ 
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Corollary 4.3. When ^i< ^ 2 , the system of equations 

(40) wi?oo = zw 

has solutions w G for all z£ {zi, fii/ 

When Hi > 1 ^ 2 , the system (40) has solutions w G for all z G (^^i, 1). 

Note that if //i < /i 2 ; it is not certain whether (40) has solutions for 
z G [hi/h2A)j but any such solutions will not be in In Remark 6.3 we 
show that such solutions exist only for z = hi/H 2 - 

For us to be able to apply Theorem 2.4, the vector w must be nonnegative. 
To investigate this, we start by generalizing (31) and (32) to 

(41) Po{x;z) = l, 

(42) ^Pi{x;z) = X + X +H 2 i'i-- z), 

—Pn{x;z) = {x + X + Hi + Ai 2 (l - z))Pn-i{x-,z) - XPn- 2 {x;z), 

(43) ^ 

n > 2 . 

For any given real and positive value of (41)-(43) define a sequence of 
orthogonal polynomials Pn{x\z). When x = 0, they reduce to (31) and (32), 
from which we deduce the fact that Wn = Pni0]z). Moreover, we shall see 
that Pn{0]z) is positive for all n if and only if the zeros of all the Pn{x\z) 
are less than zero. Thus we can study conditions for the positivity of w via 
the properties of the polynomials Pn{x;z). 


Lemma 4.4. For z> 0, the sequence {Pn{x-, 
ity relationship 

z)} satisfies the orthogonal 

/ Pn{x-, z)Pm{x-, z)fj{dx) = 

1 1 ^n,mi 

J supp('0) 

VMI/ 

where 


suddIL)-/ 

PP^^^“lkW,r(z)]U{Y(z)}, 

if z<pi, 
if z> pi, 

t { z ) is given by (30), 



(44) a{z) = -X-Hi-H 2 {'^-z)-2 



X{z) = 


and 

(45) 


H 2 ]il- z). 
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The measure ijj is given by 


'tp{dx) 


2 a/ 1 - (x + A + + H2{1 - z)Yz/\\[i\ 

vr 1 - {x + X +- z))z/X 


'4’{{x{z)}) = i 


X 

Zfil 


if z> pi. 


a <x <T, 


Proof. For fixed z>0, let 
(46) Tn{x) = 

It follows that Tq{x) = 1, Ti{x) = 2x — b and Tn{x) = 2xTn-i{x) — T„_ 2 (x), 
where 


Pn 2x\ 




- X- Pi -/i 2 (l - z)-,Z 


b = 



The Tn’s are perturbed Chebyshev polynomials, for which the orthogonalizing 
relationship is given (see [2], pages 204 and 205) by 


2 

TT 


Tn{x)Tm{x) dx 

7-1 ^ ^ ’l + h^-2hx 



-^n^rri'i 


where = 1 if | 6 | > 1 and 0 otherwise. Substituting (46) and rewriting 

yields the result. □ 


As a consequence we have the following. 

Lemma 4.5. For each value of z > 0, Pn{x;z) has n distinct real ze¬ 
ros Xn,i < • • • < Xn,n CLnd thcsc zcros interlace. That is, for all n> 2 and 
i = I,... ,n — I, 


Xn,i ^ 

Proof. The lemma follows from a well-known result for orthogonal 
polynomial sequences (see [2], Theorem 5.3). □ 

The support of the measure ip is intimately related to the limiting behavior 
of the zeros of the Pn{x‘,z). Some results are stated in the lemma below. 
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Lemma 4.6. The sequences of smallest, second-largest and largest zeros 
of the Pn{x]z) possess the following properties: 

{xn,i}'^=i is a strictly decreasing sequence with limit (7{z); 
{xn,n-i}^=i is a strictly increasing sequence with limit t{z); 
{xn,n}^=i is a strictly increasing sequence with limit 


where 



ifz< pi, 
if z> Pi. 


For a proof, see [2], Section II.4. 

Lemma 4.7. Let z> 0. Then Pnix; z) is positive for all n if and only if 

X > Xi{z). 

Proof. The leading coefficient of Pn{x;z) is positive for all n, which 
implies that Pn{x', z) is positive for x > Xn,n- Since Xn,n is strictly increasing, 
we know that Pn{x; z) is positive for all n if x > Xi{z)- Conversely, Pk{x; z) 
is negative for x £ {xk-i,k,Xk,k) and so the interleaving property given in 
Lemma 4.5 implies that, for every x < Xn,n, Pkix',z) is less than zero for at 
least one k £ {1,... ,n}. Thus, if x < Xi(z), Pk{x;z) is less than zero for at 
least one k £ Z^. □ 

Next, let us return to the question of when the vector w which solves 
(31) and (32) is positive. 

Lemma 4.8. The vector w is positive if and only if Xiiz) < 0. 

Proof. This follows immediately from Lemma 4.7 and the fact that, 
for a given value of z, Wn = Pn(0; z). □ 

Lemma 4.8 implies that, to decide whether w is positive, it is important 
to know for which values of z the corresponding Xi(z) is less than or equal 
to 0. Since 



for z < Pi 
for z> Pi 


the statement that Xi{z) < 0 implies that, for z < pi 

t{z) < 0 and so z>rj 


and, for z> pi 


xiz)<0 and so z>p 2 - 
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When Hi < H 2 , we know from Lemma 4.1 that 

11<P2<Pl 

and so w is positive for all z G [rj, 1). When P 2 : Lemma 4.1 tells us that 

pi<r]< p 2 . 

Thus w is positive only for G [p2, !)• 

Summarizing this and Corollary 4.3, we have the following theorem. 

Theorem 4.9. When pi < H2, the system of equations (19) has positive 
solutions w £ for all z£ [p,hi/h2)- 

When Hi > H2, the system (19) has positive solutions w £ for all z £ 

[P2,l). 

Theorem 4.9 states a very interesting result. Together with Theorem 2.4, 
it indicates that it might be possible to have level-phase independent sta¬ 
tionary distributions of the tandem queue for a range of different z. The key 
point is whether the vector w that satisfies (19) also satishes (18). 

In fact it has been well-known since the work of Burke [1] and Jackson [5] 
that the decay rate of the stationary number of customers in the second 
queue is p 2 irrespective of whether pi ^ P '2 or Hi> H 2 , and not any of the 
other possible values of z. Why should this be the case? The answer is that 
ttq, the distribution of J at level 0 satisfying (18), is precisely the vector -w 
that satisfies (19) with z = p2- In other words, the decay rate is that value z 
for which i?oo which has the proper 2 ;“^-invariant measure. 

This leads us to ask the question that if we varied Qi, and thus (18), 
can we get a vector w that satisfies (19) for a value of 2 ; / p 2 - If we can do 
this, we shall have changed the decay rate of the stationary distribution of 
the number in the second queue by changing the transition structure only 
when the second queue is empty. In Section 6 , we shall see that it is indeed 
possible to do this. 

Before we move on, we shall briefly discuss how the results of Takahashi, 
Fujimoto and Makimoto [17] apply to the tandem network example. An ap¬ 
plication of Corollary 1 of [17] shows that if there exists a scalar 2 ; and vector 
w £ that satisfy (28) and a vector y that satisfies 

(47) Qiz)y = 0 

with wy < 00 and 2 ;“^wAoy 7 ^ 2 ;wA 2 y, then (19) is satisfied, R is 2 ;-positive 
and the right eigenvector of R is dominated elementwise by y. Furthermore, 
by Corollary 2 of [17], if ttq is such that vroy < 00 , then the decay rate of 
the QBD process is equal to 2 ;. 

After some calculation, we see that, when Hi> H 2 , the conditions of Corol¬ 
lary 1 of [17] are satished with z = p2, w such that = Pi and y such that 
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Uk = P2 ^- Because ttq = w, we can then derive the fact that the decay rate 
is p 2 - However, this reasoning does not work if pi < p 2 and, even if pi> p 2 , 
by altering Qi, we can create the situation where ttq is a 2 ;“^-invariant mea¬ 
sure of R for a different value of z. In this case ttq must necessarily be such 
that TToy = oo. We give an example of such a construction in Section 6. 

5. The case where m is finite. In the case where m is finite, because the 
tandem queue is assumed to be stable, we know by Corollary 2.6 that the 
nonzero eigenvalues of Rm are given by the values of z within the unit circle 
for which = 0. Thus {z , w) is an eigenvalue-eigenvector pair 

of Rm if and only if zero is an eigenvalue of (z) with corresponding 

eigenvector w. In the first part of this section, we shall explore the relation¬ 
ship between the values of x for which det(3:Im+i — = 0 and the 

zeros of a sequence of orthogonal polynomials closely related to the Pn{x] z). 

Let the sequence of polynomials Pnix', z), be defined such that Po{x] z') = \ 
and, for n > 1, 

Pn{x;z) = Pn{x\z) - Pn-l{x-,z). 

Pi 

The polynomials Pn{x;z) satisfy the recursion 

(48) Po{x]z) = l, 

(49) ^Pi{x;z) = x +p 2 {f-z), 

(50) ^P 2 {x-,z) = {x + X + pi + /i 2 (l - z))Pi{x]z) - A (1 - z), 

—Pn(x;z) = (x + X + Pi + P2(f - z))Pn-i(x;z} - XPn- 2 (x;z}, 

(51) ^ 

n > 3. 


Lemma 5.1. For each value of z>0, Pn{x]z) has n distinct real zeros 
Xn,i < • < Xn,n which interlace. Moreover, Xn,n > Xn,n and 

(52) Xji^i < Xn^i < Xn,i-\-l, i — 1, . . . , U 1. 

Proof. The statement of the lemma follows from Exercise 1.5.4 of [2]. 

□ 


Lemma 5.2. (a) The eigenvalues of Q^^\z) are the zeros of Pn{x;z). 

(b) The eigenvalues of Q^'^\z) are the zeros of Pn{x\z) and for each such 
eigenvalue x, the corresponding left eigenvector is given by 

{Po{x] z),Pi{x-, z),..., Pn-i{x-, z)). 
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Proof. We have already observed [after (43)] that 0 is an eigenvalue 
of if and only if it is a zero of Pn{x;z). For the general case, let 

In denote the identity matrix of dimension n. Write for and 

similarly for Q^'^\z). The characteristic polynomial of is 

det(x/i — = X + A + /r 2 (l — z). 

Because the are tridiagonal, we have 

det(x /2 - = {x + X + fii + fi 2 {I - z)) det(x/i - - —A 

z 

and, for n > 3, 

det(x/n - = ix + X + fii + /X 2 (l - z)) det(x/n-i - 

- ^Adet(x/n-2 - <3^"'“^^). 

Hence, we see that /z)"^Pnix\z) is the characteristic polynomial of Q^'^\ 
and thus, for each n > 1, the eigenvalues of are the zeros of Pn{x]z). 
This proves (a). 

To show the first part of (b), observe that the characteristic polynomial 
of satisfies 

det(xl„ - = (x + + /Z 2 (l - z)) det(x/n-i - <3*'"'”^^) 

- ^Adet(xl„_2 - 

= det(x/n — — Adet(x/n_i — 

= (^) (^Pnix-,z) - ^Pn-lix;z)^. 

Hence, the eigenvalues of Q*'"') are the zeros of Pn{x',z). 

To prove the second part of (b), it is readily checked that for each eigen¬ 
value X of <3^"'\ for which Pn{x‘,z) = XzPn-i{x; z )/we have 

{Po{x-,z),Pi{x-,z), . . . ,Pn-lix-,z)){xIn “ = 0 . □ 

Since Rm is positive (see Remark 3.1), an eigenvector w = (rco, wi) of Rm 
can be positive if and only if wi is the Perron-Frobenius eigenvector of Rm- 
By Theorem 2.5, w is an eigenvector of with eigenvalue zero and, 

because is an ML-matrix (see [16]), w can be positive if and 

only if zero is the largest eigenvalue of In Lemma 5.3, we shall 

show that there is exactly one z G (0,1) such that the largest eigenvalue of 
Qii^+^)(^z) is zero. 
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Lemma 5 . 3 . For m > 1 there exists a unique number Zm+i in the inter¬ 
val (0, 1) such that Xm+l,m+l{Zm+l) = 0. 


Proof. Consider the nonnegative matrix 


(53) 


'^m+l (z) 


z(X + {z) 

^ + t^l + h2 


and let ^rn+i{z) denote its largest eigenvalue. For z£ (0,1), r.m^i{z) is 
a substochastic matrix, which is stochastic when z = 1. Thus Lemma 1.3.4 
of [11] can be applied. Specifically, under the appropriate stability condition 
(23) or (24), the equation z = has exactly one solution Zm+i £ (0,1). 

It is readily seen that 2 ; = ^m+i {z) if and only if the maximum eigenvalue of 
is equal to zero and the result follows. □ 


We have now proved the following theorem. 


Theorem 5.4. When m is finite, the maximal eigenvalue of Rm is given 
by the unique Zm+i £ (0,1) such that Xm+i,m+i{zm+i) = 0. The correspond¬ 
ing eigenvector is strictly positive. The eigenvectors corresponding to any 
other nonzero eigenvalue of cannot be nonnegative. 

In view of (12), it is obvious that Theorem 5.4 determines the geometric 
decay rate of the level process we were looking for. The following corollary 
concerns the limiting behavior of this decay rate as m, the size of the first 
buffer, tends to infinity. 


Corollary 5.5. Let be the Perron-Frobenius eigenvalue of Rm for 
finite m. 

If hi < M2; then ri,r2,... strictly increases to ij. 

On the other hand, if jxi > H2, then ri,r2,... strictly increases to p2. 

Proof. It was stated in Lemma 4.6 that {xn,n{z)} strictly increases 
to Xiiz)- To prove that {xn,niz)} also increases to Xi(^;), the interlacing 
property ensures that we need only to show Pn{xiiz)] z) > 0 for n > 1. 

For the case z> pi we have Xi( 2 :) = xiz), and from (48)-(51) it is easily 
checked by induction that Pn{xiz)',z) = (1 — z){X/pi)^ > 0. 

For the case z < pi, where Xi(^) = '>'{z), first note that 

Pn{T{z)]z) - y/zpfPn-l{T{z)] z) > 0. 

This can be shown easily by induction, using (41)-(43). Since we can write 
Pn{T{z);z) = Pn{T{z)]z) - ^/zpfPn-l{T{z)] z) + (^/ipT - Zpi )P„_l (t (z); z) , 



TANDEM JACKSON NETWORK 


23 


0 < zpi < 1 and Pn-i{T{z); z) > 0 (see Lemma 4.7), we conclude that Pn{T{z)]z) > 0. 

Now, by Lemmas 5.3 and 4.5, the sequence = {zm+i} increases strictly 
to a z* € (0,1) which is the unique zero of Xii^) the interval (0,1). Assume 
that Pi < P 2 - By Lemma 4.1, this can occur only when r] < pi. In this case 
Xiiz) = t(z), which has a zero at z = p. Thus = {zm+i} increases strictly 
to Tj. On the other hand, when pi> p 2 , Lemma 4.1 implies that z > pi and 
Xiiz) = x(z}, which has its zero at z = p 2 - The sequence Vm = {zm+i} then 
increases to p 2 - D 

The above result shows that we must clearly distinguish between two 
possible regimes. These correspond with the different cases identified in 
Lemma 4.1. In the first regime, when pi < P 2 , the first queue is the bot¬ 
tleneck and limm^oo sp(7?m) ='n- In the second regime, when pi > p 2 , the 
second queue is the bottleneck and limm^oosp(i2m) = P 2 - Note also that, 
in this second regime, Lemma 4.6 tells us that the limit of the sequence of 
the maximal eigenvalues of Rm is different from the limit of the sequence 
of second-largest eigenvalues and so the limiting spectrum of Rm has an 
isolated point. 

We observed in Section 4 that the decay rate of the tandem Jackson net¬ 
work with infinite waiting room at the first queue is always p2 irrespective 
of whether pi < p 2 or pi> p 2 - We thus see that, when pi> p 2 , the limiting 
decay rate of the finite truncations is indeed that of the infinite system. How¬ 
ever, if Pi < P 2 -, the limiting decay rate of the finite truncations is different 
from that of the infinite system. We have thus provided a counterexample to 
the idea that the decay rate of a QBD process with infinitely many phases 
can be derived by calculating the decay rates of finite truncations and then 
allowing the point at which truncation occurs to grow to infinity. 

6. Varying the decay rate. An interesting question arises from the ob¬ 
servations at the end of Section 4. By appropriately changing the^transition 
intensities at level zero, in other words changing the entries in Qi, can we 
ensure that the stationary distribution decays at a rate that is given by any 
of the feasible values of z? In changing Qi we have a great deal of freedom, 
so we might expect tha^the answer is yes. In fact it is. Below, we present 
two examples in which Qi remains a tridiagonal matrix. 

Example 6.1. Suppose pi> P2- We wish to have a decay rate z, satisfy¬ 
ing the conditions in Theorem 4.9, which in this case means that z £ [p 2 , 1). 

By Lemmas 4.2 and 4.8 the vector w given in (34) will be positive and in 
We now replace each A in Qi by a phase-dependent A*. Specifically, we define 
Aj recursively by 

^ = P 2 Z, 

(54) 

Aj = Ai_i- \- P 2 Z- pi, 


Wi 


i = l,2,.... 
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The following proposition shows that this defines proper transition inten¬ 
sities. 


Proposition 6.1. The sequence {Aj}^Q is strictly positive. 


Proof. Let (/)(u) be the generating function of the sequence 'Wi,W 2 , _ 

From (32) we find after some algebra that 


(j){v) 


_/ii(l - vz) _ 

Xzv"^ - z{X + IJ.I+ //2(1 - z))v + //I ' 


Substituting v = 1 gives 


(55) 


OO 

(j){i) = j2wi = 


i=0 


hi 

hi - h 2 z' 


Now, consider the sequence yQ,yi,..., with yi = XiWi- This sequence satisfies 
the recursion 


yi = yi-i + {y 2 Z-hi)wi, i = l, 2 ,..., 

with yo = h 2 Z > 0. If y 2 Z > hii then all y* (and hence A*) are obviously 
positive. On the other hand, if yL 2 Z < yi, then yi,y 2 ,... is monotone de¬ 
creasing, with 

OO 

lim yi = fi2Z + {h2Z - hi) V] = 0 , 

i—*oo 

2 = 1 

which shows that all Aj are positive in this case as well. □ 

The recursion (54) ensures that w is a (/i 2 -z)“^-invariant measure of RooQi- 
Moreover, w satisfies wQi = —y2Z'w. Hence w(Qi -|- R00Q2) = 0 , so that 
by (5) and Theorem 2.2 it follows that the stationary distribution tt = 
(7ro,7ri,...) of {Yt, R) is given by 

Tin = cwR'R = z^cw, n>0, 

for some normalizing constant c. Thus, it is clear that z indeed is the decay 
rate in this model. 

This example has demonstrated the counterintuitive result that, by chang¬ 
ing the arrival intensity to the first queue when the second is empty, such 
that it becomes dependent of the number of customers in the first queue, 
we can produce any decay rate in the range [p2,Y). 

Example 6 . 2 . Suppose pi < y 2 - We wish to have a decay rate z, with 
.2 G [t], P2] ■ Again, the vector w given in (34) is positive and in . This time 
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we leave the arrival rate unchanged, but introduce an extra transition rate Vi 
from state (0,i) to (0,i — 1). This corresponds to removing customers from 
the first queue, without introducing them to the second queue. The values 
Vi are recursively defined as 


1^1 


Vi+i 


(A - H2z)wo 
wi 

{Vi + X + Hi- H2z)Wi - \Wi-l 

Wi+l 


Proposition 6.2. The sequence {vi}^Q positive. 

Proof. The proof is similar to the proof of Proposition 6.1. First, we 
claim that 

(56) {X + Hi-T2z)wi<Xwi-i, i = l,2,.... 

To see this, consider the sequence of polynomials {0n}, defined by &nix) = 
{X + Hi ~ T 2 z)Pn{x) — XPn-i{x), n > 1, with the polynomials {Pn} given 
in (41)-(43). Imitating the proof of Lemma 4.5 for 0„ instead of Pn, we find 
that the zeros of {0n} interlace, that the largest zero of 0^ is larger than 
the largest zero of Pn and that the second largest zero of 0„ is smaller than 
the largest zero of Pn- Now, for 2 : G ['il,P 2 ], the largest zero of Pn is less than 
or equal to 0. Hence, 0^ can have at most one zero greater than 0. It is easily 
verified that the largest zero of 0i is given by (A — H 2 z){h 2 Z^ — (A + /ri + 
H 2 )z + ^i)/(z(A — H 2 Z + Hi))^ which is strictly positive for all 0 < 2 : < p 2 . 
Hence, all 0^ have exactly one strictly positive zero. Thus, because the 
leading coefficient of 0^ is positive, 0n(O) must be strictly negative, which 
is equivalent to (56). 

Second, let m = XiWi, i = 1,2,.... We have, for alH = 2,3,..., 

Vi = Ui-i + {X + Hi- h2z)wi - Xwi-i, 

where yi = X — H 2 Z > 0. Thus, using (56), yi,y 2 , ■ ■ ■ is a strictly decreasing 
sequence with limit 

00 00 

X- H2Z + {X + Hi- H2z)'^Wi - X'^Wi = 0, 

i=l z=0 

where we have again used (55). This shows that all Vi are positive. □ 

As above, the recursion ensures that w(Qi + R 00 Q 2 ) = 0, so that the 
stationary distribution of is given by 

Tin = cwPX^ = CZ^VJ, 


n > 0, 
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for some normalizing constant c, from which it is clear that z is the decay 
rate in this model. 

Thus, by allowing customers at the first queue to be removed at specified 
rates when the second queue is empty, we have been able to produce any 
decay rate in [r], p 2 ]. Note that it is not possible using this scheme to produce 
a decay rate greater than p^- However, we can do so using a scheme such 
as that in Example 6.1, which is also applicable here, since the proof of 
Proposition 6.1 did not use the fact that pi> P 2 - 

In the examples given above, Qi was constructed such that the corre¬ 
sponding ttq is exactly equal to some ^“^-invariant measure of Roo- As 
a consequence, the stationary distribution of (Yt,Jt) has a product form. 
However, it is also possible to construct Qi, so that ttq is a finite linear 
combination of 2 “^-invariant measures of Roo. In that case the stationary 
distribution does not have a product form. The decay rate is then given by 
the largest value of 2 with corresponding z“^-invariant measure in the linear 
combination. 

Remark 6.3. When pi < P2, the minimal attainable decay rate cannot 
be less than p and when pi > p 2 the minimal attainable decay rate cannot 
be less than p 2 . This follows because p and p 2 respectively are the smallest 
values of 2 for which a z“^-invariant measure exists. 

The maximal attainable decay rate is produced in a different way. Clearly, 
when pi> p2, any decay rate in [/92,1) can be produced. However, when 
it is not immediately clear whether the matrix Roo has a value 
z G [pi/p2,l) with a corresponding z“^-invariant measure w that is not 
in If such a measure did exist, the behavior at level 0 would be such 
that the first queue is unstable, while the second remains stable and has 
decay rate z. A physical argument tells us that this is possible only when 
z = pi/p2- if the first queue is unstable, then the second queue behaves like 
a standard M/M/1 queueing system with arrival rate pi and service rate 
P 2 . This implies that its decay rate could never be larger than pi/p 2 - 

7 . Hitting probabilities on high levels: general QBD processes. In vari¬ 
ous applications one is interested in hitting or exit probabilities of the level 
process. In this and the following section, we shall consider the decay rate 
of these probabilities, first in the context of a general QBD with possibly 
infinitely many phases and then in the context of the M/M/1 tandem. 

For a <b, define to be the first time that either level a or level b is hit. 
Also, let Pfcj denote the probability measure under which the QBD process 
starts in {k,i). For fc > 0, we are interested in the decay rate as R —> oo of 
the first exit probabilities 

Pk (b j) := = j, Yj^k = K), 
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which we collect into a matrix . Define the matrix to be equal 
to ■ Thus, Hq is the 0 matrix and it is not difficult to see that, for 
k>l, Hi,P[ 2 ,... satisfy the recursion 

Qo + QiHk + Q2Hk-iHk = 0 , 

and the matrix P^ is given by 

(57) P^ = HkHk+i---HK-i. 

The following result is essentially a restatement of Lemma 8.2.1 of [7]. 


Lemma 7.1. The sequence of matrices, P[i,H 2 , ■ ■ ■ increases elementwise 
to the matrix H which is the minimal nonnegative solution to the matrix 
equation 

(58) Qq + QiH + Q2H'^ =Q. 


For the case when m is finite, it was shown in [9], Lemma 3.1, that, when 
Condition 2.1 holds, either H is primitive or, by a suitable permutation of 
the states, it can be written in the form 


(59) 


H = 


Li 

L.i 


0 ■ 
L. ’ 


where Li is primitive and L. is lower triangular with its diagonal entries 
equal to zero. A similar result can be established even when m is infinite. (At 
the time of writing, this result, due to Latouche and Taylor, is unpublished. 

An explanation can be obtained from Peter Taylor at p.taylor@ms.unimelb.edu.au.) 
Thus, when m < oo, H has the decomposition (59), where L. is lower tri¬ 
angular and Li is irreducible and aperiodic. It follows from (14) that the 
convergence norm c of Li is well defined and given by 

c= lim (L^(i,j))^/”. 

n —>-oo 


Let S* be the set of indices corresponding to Li and partition the matrices 
iLfc, conformally with our partition of the matrix H, so that 

0 

The decay behavior of the hitting probabilities is described in Theorem 7.3. 
However, first we need a lemma. 


(60) 


H.= 


Lemma 7.2. For any phase i, there exist numbers k* and N* such that, 
for k > k* and N > meix{k,N*), there is a u with 

(61) 
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Proof. First note that, for any given N and k, say Nq and ko, there 
may not be a z^o £ such that > 0. Taking into account the 

irreducibility of the doubly inhnite process with generator (2), this could be 
because every path of positive probability from state (A;o,i) to states of the 
form {Nq,uq) with vq G S* does one of the following: 

1. passes through a state of the form (NQ,m) with m^'E* [by the decom¬ 
position (60), this can occur only if i ^ S*]; 

2. goes through level zero; 

3. does both 1 and 2. 

Consider a path from {k, i) to a state with Nq> k and vq G S* of the 

form described in 1 above. Let N* be the highest level it reaches. Any path 
from {Nq,i'q) to level N* +1 must hit level N* -|-1 in a state {N* -|- 1, z^) with 
z^ G S* and, by irreducibility of the process with generator (2), there must 
be such a path. Concatenating these two paths, we have constructed a path 
of positive probability from (fc, i) to {N* -|- 1, z^) which first hits level N* + 1 
in phase z/ G S*. If this path does not pass through level 0, then we have 
constructed a path as desired. If it does go through level 0 we modify it as 
described below. 

If, after performing the modification described above, all paths from state 
{ko,i) to states of the form (iVo, z/q) with vq G S* pass through level 0 choose 
one such path let —A: be the lowest level reached by the path and put k* = 
ko + k. Then if k > k*, there is a path of positive probability from {k,i) 
to a state of the form {Nq + k — ko,i'o) with zzg G S* which does not pass 
through level 0. This shows that, for all phases i, we can choose k* such that 
when k > k* there exists a path of positive probability which does not pass 
through level 0 from state {k,i) to any level N > ijiax{k, Nq). The lemma is 
thus proved. □ 


Theorem 7.3. Consider an irreducible QBD process with a finite or in¬ 
finite phase space, satisfying Condition 2.1 and (11). Then for i G {0,1,... } 
and j G E* there exists k* such that, for k > k*, 


(62) 


lim 

K^oo 


\ogP^{i,j) 

K 


log(c). 


where c is the convergence norm of Li. For i,j ^ S*, there exists K* such 
that, for K > K*, 

(63) Pk^{^,j)=0■ 


For i gE*, j ^E* and all k < K, 

(64) Pk^ii,j)=0- 
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Proof. For the case where i,j G S*, we have 


K 


< 


K 

log{{Li)^-’^{i,j)) 


K 


K-k 

K 




so that, letting K —> oo, we find by (14) that 

log(Pf 


(65) 


limsup ■ 

K^oc 


K 


<log(c). 


To show the opposite, choose k*, N* and so that (61) is satished. Then, 
for A; > fc*, > max(A:, N*) and K > N, we have 


( 66 ) 


(b j) = E 

i 


Now we have 

log(-Pfc^(i,j)) ^ \og{P^{i,v)) ^ log((L E)^~^(t^,j)) 


K 


K 

jN I 


K 




so that, letting K ^ oo, we find that 

,log(Pfc^(z,j)) 


lim inf ■ 
K^oo 


K 


> log(cAr), 


(A) 


where cat is the convergence norm of L) . Since this holds for all N and, 
by Lemma 2.3, cat —> c as —> oo, we see that 

.log(Pf (f,j)) 


(67) 


lim inf - 
K^oo 


K 


>log(c). 


which, together with (65), gives the result in this case. 

When i and j G S*, we can still use Lemma 7.2 to choose k* and N* 
so that, when N > N* and k> k*, there exists a G S* such that (61) is 
satished, and argue as above from (66) that (67) is satished. 

To get the analogue of (65), observe that, by (57) and (60), we must be 
able to write 

r=k 


ihJ) 
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r=k 

Now, because L. is lower triangular, there is a positive integer s* such that 
Lf (i, v) = 0 for all s > s* and v . Thus, for K > k + s* + 

s=0 

where 

D = |]LfL.iTf-T 

s=0 

Consider the Markov chain with transition matrix H. Let r(j) be the first 
time greater than or equal to s* + 1 that the chain visits state j £ S* and let 
be the probability that T{j) = n, conditional on the chain starting 
in state i ^T,*. Then it follows easily that 

n=s*+l 


and that 
( 68 ) 
where 


and 


r,r/- ■ N F{h3]z)L{j,j]z) 
DL{i,j-z) = -—, 


DL{i,j-z) = Y,{DL^){i,j)z^, 

n={) 

oo 

F{i,j-z)= E 


n=s*+l 


L(j,j;z) = E^iaJ>"- 


n=0 


It is clear that < {DLi){i,j) and so the convergence radius of the 

power series F[i,j\z) is greater than or equal to the convergence radius of 
the power series DL{i,j]z). Therefore, by (68), the convergence radii of the 
series DL{i,j\z) and L{j,j-,z) are the same. Thus we have 


lim 

fc—>CO 


log((Z)Lf-^-^-‘)(z,j)) 


log(c) 


K 




TANDEM JACKSON NETWORK 


31 


and so 


limsup 

K^oo 


log(Pf (i,j)) 
K 


< log(c). 


Thus, the result is proved for and j G S*. 

When z,j ^ S*, using the same definition of s* as above, it follows that, 
for all K > k + s* ^ 

(69) ^’f(bj)=0, 

while we immediately have = 0 when i G S* and j ^ S*. This proves 

the second part of the theorem. □ 


To finish off this section, we present some results for the matrix Hm that 
are analogous to Theorem 2.5 and Corollary 2.6 for the matrix This 
will allow us to conclude that the eigenvalues of Rm and Hm coincide when 
m < oo; see Corollary 7.6. 

As for (21) it is easy to see that, when the column vector v and scalar z 
satisfy 77mv = z'v, then 

(70) {Qq +zQi +z^Q2)yr = 0. 

Again, under certain conditions on v and z, the converse is true, irrespective 
of whether m < oo or m = oo. This is shown in the following theorem, which 
is basically Theorem 5.3 of [14]. 

Theorem 7.4. Consider a continuous-time QBD process with generator 
of the form (1). Then, if the complex variable z and the vector v = {vk} are 
such that \z\ < 1 and J2k < oo, then (70) implies that 


Following essentially the same proof as for Corollary 2.6 we have a char¬ 
acterization for the case m < oo. 


Corollary 7.5. For an irreducible QBD process with a finite phase 
space, satisfying (11), the eigenvalues of Hm are all the zeros of the polyno¬ 
mial 

(71) det{Qo-\-zQil- z‘^Q 2 ) 

that lie strictly within the unit circle. 

The following result is now immediate from Corollaries 2.6 and 7.5. 

Corollary 7.6. For an irreducible QBD process with a finite phase 
space, satisfying (11), the eigenvalues of Hm and Rm coincide. 

In particular, when m < oo the hitting probabilities P^{i,j) have the 
same geometric rate of decay as the stationary probabilities in (12). 
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8. Hitting probabilities on high levels: the tandem network. Assume 
that the tandem queue starts in state (l,i) with i > 1, that is, with one 
customer in the second queue and i>l customers in the first queue. It is 
possible that the process can first hit level 2 before level 0 with any number 
j >1 — 1 customers in the first queue, that is, in any state (2, j) with j >i — l. 
If the queue starts in state (1,0), then it can first hit level 2 before level 0 
with any number of customers in the first queue. A consequence of this is 
that the matrix Hm for this QBD process is irreducible. It then follows from 
Theorem 7.3 that 


(72) 


lim 

K—^cx) 


log Pf{iJ) 
K 


log(c). 


where c is the convergence norm of Hm- Thus, to calculate the decay rate of 
the hitting probabilities, we need to calculate the convergence norm of Hm- 

To do this for the case m = oo,we could follow a line of reasoning similar to 
that we used in Section 4 based upon Theorem 7.4 instead of Theorem 2.5. 
Thus, we would calculate conditions for a solution v to Qiz)^ = 0 to be 
both positive and in However, unlike the 2 :“^-invariant measure of Roc, 
which affects the decay rate of the stationary distribution, the 2 :“^-invariant 
vector of Hoc has no effect on the decay rate of the hitting probabilities. 
We thus choose to calculate the decay rate of the hitting probabilities in 
a more efficient way. 

By Corollary 7.6, for finite m, the eigenvalues of Rm and Hm coincide. 
Thus Theorem 5.4 and Corollary 5.5 apply to Hm as well as to Rm- In 
particular, we have the following theorem. 


Theorem 8.1. When m is finite, the following results hold: 

1. The maximal eigenvalue hm of Hm is given by the unigue Zm+i G (0,1) 
such that Xm+l,m+l(-^m+l) ~ 0. 

2. If ill < g. 2 , then h\,h 2 ,-- - strictly increases to i]. On the other hand, if 
hi> h 2 , then /ii,/i 2 ,... strictly increases to p 2 - 

By Lemma 2.3, it follows that the convergence norm of Hoc is then equal 
to r] if Pi < p 2 and p 2 if pi> p 2 - Together with Theorem 7.3, this gives us 
the following theorem. 


Theorem 8.2. 1. When m is finite. 


(73) 


lim 

K^oo 


\ogP^{i,j) 

K 


log{hm)- 


2. When m is infinite: 
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(a) when //i < /i 2 


(74) 



(b) when > /i 2 


(75) 



The decay rate of the hitting probabilities in the case of infinite m is thus 
the same as the decay rate of the stationary number in the second queue 
when Hi > H 2 , but it is not the same when hi < fJ' 2 - This is an interesting 
property of the tandem Jackson network, which we believe was not known 
previously. 

There are two further interesting questions about the decay rate of the 
hitting probabilities that we have not addressed above. The first question 
involves the decay rate of J2j i^j) as K —> oo in the case m = oo. It 
follows immediately from Theorem 8.2 that this decay rate is larger than 
r] and p 2 when pi < //2 and fJ-i > H 2 , respectively. We conjecture that it is 
equal to these values, although we currently have no proof of this. 

The second question involves the decay rate of the hitting probabilities 
on level K if the process starts in level 1 according to some distribution xi. 
Of particular interest is the situation when xi is the stationary distribution 
TTi at level 1. These hitting probabilities are given by the components of 



(76) 


When m < oo, the decay rates of these probabilities are easily seen to be the 
same as the decay rates of P/^(i,j), given by Theorem 8.2. However, when 
m = oo, this need not necessarily hold. Indeed, our experience with the 
matrix i?oo would lead us to believe that we could achieve any decay rate in 
[T],fj,i/H 2 ) if pi < P 2 and any decay rate in [p 2 , 1) if pi > P 2 - However, since 
we have no theorem analogous to Theorem 7.4 that can inform us about the 
z“^-invariant measures, rather than the z“^-invariant vectors, of Hoo we do 
not currently see how this problem can be approached. 
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